A deterministic algorithm that emulates learning with random weights
نویسندگان
چکیده
منابع مشابه
A deterministic algorithm that emulates learning with random weights
The expectation of a function of random variables can be modeled as the value of the function in the mean value of the variables plus a penalty term. Here, this penalty term is calculated exactly, and the properties of different approximations are analyzed. Then, a deterministic algorithm for minimizing the expected error of a feedforward network of random weights is presented. Given a particul...
متن کاملErgodic averages with deterministic weights
i.e., there exists a constant C such that SN(θ, u) ≤ CN . We define δ(θ, u) to be the infimum of the δ satisfying H1 for θ and u. About H1, in the case where θ takes its values in U (the set of complex numbers of modulus 1), it is clear that for all sequences θ and u, δ(θ, u) is smaller than or equal to 1 and it is well-known (see [Ka] for example) that it is greater than or equal to 1/2. Few e...
متن کاملAn iterative learning algorithm for feedforward neural networks with random weights
Feedforward neural networks with random weights (FNNRWs), as random basis function approximators, have received considerable attention due to their potential applications in dealing with large scale datasets. Special characteristics of such a learner model come from weights specification, that is, the input weights and biases are randomly assigned and the output weights can be analytically eval...
متن کاملOn Random Weights and Unsupervised Feature Learning
Recently two anomalous results in the literature have shown that certain feature learning architectures can yield useful features for object recognition tasks even with untrained, random weights. In this paper we pose the question: why do random weights sometimes do so well? Our answer is that certain convolutional pooling architectures can be inherently frequency selective and translation inva...
متن کاملFADO: A Deterministic Detection/Learning Algorithm
This paper, proposes and studies a detection technique for adversarial scenarios (dubbed deterministic detection). This technique provides an alternative detection methodology in case the usual stochastic methods are not applicable: this can be because the studied phenomenon does not follow a stochastic sampling scheme, samples are high-dimensional and subsequent multiple-testing corrections re...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Neurocomputing
سال: 2002
ISSN: 0925-2312
DOI: 10.1016/s0925-2312(01)00695-6